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METHOD AND APPARATUS FOR FACIAL IMA G E ACQUISITON AND 
RECOGNITIO N 



Method and Apparatus for Facial Image Acquisition and Recognition 
Technical Field of the Invention 

[001] The present invention relates generally to the field of image processing and recognition. 
More specifically, it relates to a method and an apparatus for faotfacial image acquisition and 
recognition-wkef e, wherein an active l ights a re used - near infrared (NCR.) light within invisible 
light spectrum is applied to illuminate the a target face. 

Background of the Invention 

[002] Face recognition is a biometric technology in which the technology related to 
computers, image processing, and pattern recognition is also involved to perform person 
identification based on facial images. Recently, especially after 9.11 terror attacks, many 
countries in the world have attached a great importance to their public security. Accordingly, 
face recognition technology has been greatly noticed much more than ever before. 
[003] Biometric authentication refers to a class of high tech recognition technologies that use 
human biometric traits to carry out person verification and identification. Biometric traits of a 
person, such as fingerprint, palm print, iris, deoxyribonucleic acid (DNA), are unique and 
stable for the individual; they cannot be duplicated, stolen and forgotten. Because each person's 
characteristics are distinct from others, it is possible to accurately identify a person by using 
his/her unique biometrics. Existing biometric recognition methods generally i nclude face 



recognition, fingerprint recognition, sound recognition, palm print recognition, signature 
recognition, eye iris, retina recognition and so on. 

[004] As compared to other recognition technologies, face recognition technique is of many 
advantages such that it is natural, simple and convenient, easy to operate, user friendly, 
contactless, and non-intrusive, etc. It can complete the recognition task without incurring much 
disturbance. With this technology, people no longer need to worry about touching his 
fingerprint on the fingerprint apparatusdevice, or talking to the microphone, or looking into an 
iris scanner required by conventional r ecog nition in the prior a rt. A face can be recognized 
when a person show his face to the camera. Therefore, the face recognition technology can be 
widely applied to access control, machine readable traveling documents (MRTD), e-passport, 
anti-terrorism, ATM, computer logon, safe cabinet, time attendabeeattendanee, and so on. 
[005] Typical face recognition applications include the following modes: 

Identification (1:N match) to determine a person's ID: A system (1) acquires the face 
image data, (2) extracts facial features or record from the image, (3) compares it with all or part 
of the records of enrolled persons in database to calculate the similarity scores, and (4) produce 
a sorted list based on the similarity score. Finally, the system outputs the persons ID 
corresponding to the top most similarity if the top most similarity is above an acceptance 
threshold; otherwise concludes that the person is not identified. 

Verification (1:1 match) to verify whether the claimant. In this case, the system needs 
just to compare the facial record extracted from the image with that of the claimed person to 
give the similarity score. The system either accepts the claimant if the similarity score is above 
an acceptance threshold, or reject if otherwise. 

Surveillance: Using the techniques of face image acquisition and face recognition to track 
a person in the surveillance area and determines his location. 



Monitoring: To discover the faces in the surveillance area, far or near, regardless of their 
locations, track them and separate them from the background, compare the facial features with 
those in the database. The entire process is automatic, continuous, and real-time. 

The above application modes can be widely applied in the following domains: 

Personnel identification and indexing: These can be used in computer/network security, 
bank services, smart card, access control, frontier control, etc^, 

ID card: This can be used in voter registration, ID card, passport, driver's license, work 
identification and so on^ 

Computer information safeguarding system: This uses the facial features to recognition 
user, safeguards the computer informations 

Crime suspect recognition system: This system stores face pictures and recognizes 
faces in analyzing incidents^. 

Long-distance person identification: This is applied in surveillance, monitoring, GCTV, 
traffic control, enemy-friend recognition and so on. 

[006] A face recognition process is illustrated in Fig. 1, It consists of following three 
modules: 

Image acquisition module 10: It captures face image or video images through image 
acquisition equipment (for example video camera, digital camera and so on), then, then sends 
these images or video to a computer. 

Feature extraction module20: Residing in a computer processor, this module examines 
the input image, detects the face, locate facial features such as eyes and mouth, normalize the 
face in pose and illumination, and extracts face features (face code). 

Feature matching module30: Also residing in the computer, it compares the face 
features extracted from the input image information -(face code) with those stored in the 
database40, and find the best matched one. 



[007] Obviously, the face feature database should be set up before the face recognition 
process. Therefore, as shown in Fig. 2, a face recognition system should have two main parts: 
Face Recognition (Part A), and Face Enrollment (Part B). Among them, the purpose of Part B 
is to register related personal information for the person to be enrolled, extract the face code of 
the person, and store the information and face code in the database for face recognition process 
in the future. 

[008] Both enrollment and recognition (Parts A and B) include the image acquisition and 
feature extraction modules. Of these, the face recognition part has an additional feature 
matching (comparing) module, while the face enrollment part has a data saving module. 
[009] Face feature extraction process 20 is composed of several steps: face detection or 
tracking 201, facial feature localization and face normalization 202, faeia4^face___feature 
extraction (face code generation) 203. The face detection finds the face in the input image or 
video image sequence, so that the face is separated from the background; the face tracking 
tracks detected the faces in video image sequence, face normalization or alignment uses 
localized facial landmarks (eyes and/or mouth) to normalize the geometry of the face to a 
standard pose and normalize the lighting to a standard illumination condition, face feature 
extraction calculates the face code from normalized face image. 

[010] Face matching 30 compares the face code from the input with those of the enrolled 
persons in the database 40, one by one in turn, computes the similarity matching scores, and 
gives a decision for verification or identification after referring to a similarity threshold. 
[011] To achieve reliable and accurate accuracy, face recognition should be performed based 
on intrinsic factors of the face only, mainly of 3D shape and reflectance of the facial surface. 
Variations brought about by extrinsic factors, including hairstyle, eyeglasses, expression, 
posture, and environmental lighting, should be reduced or eliminated;- The probl e m- of 






crcome Performance is existing 



4 



faoa r ecognition system varies a lot under different environmental lightfiig. j n ordei to achieve 
high performance. 

[012] jke-feseai^ah— sh«ws tha4^the-d4lforen^e-of-fase-Mo st of existing face recognition 
technologies are based on visible light images. Such technologies have difficulties in adapting 
to changes in environmental lighting: Changes in lighting cause changes in facial features; 
therefore, their accuracy deteriorates when the lighting of the face recognition environment 
differs from that of the face enrollment environment, for example, US Patent 
US200 1/003 102A1. 

[013] The research shows that the difference of facial image for same person by light change 
is much bigger than that of different persons. (Sees also Yael Adnin, Yael Moses and Shimon 
Ullman, "Face recognition: The problem of compensating for changes in illumination 
direction", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 19, No. 1, 
1,997, pp. 712-732). Existing face recognition technology depends on "passive" light source, 
that is, environmental light sources. Unfortunately, in real application, the environmental lights 
vary, and are not controlled. A change in environment light* changes the -captured face facial 
image dramatically. This in turn significantly changes extracted face features, and causes 
significant drop in recognition accuracy. 

[014] Suppose for each point Pi, there is a vector m = (n x ,n y ,n^ T , n T i Isis a unit vector, that is 
||«||=1; Assume that the light source is point source, the direction is = (s x ,s y ,Sz), then we have 
the Lambertian imaging equation model, the gray scale Ij of Pi can be written as: 

li = Pi(x, y)ri i (x,y) T • s (i) 

where i= 1, 2,..., k-p, k is the number of pixels of a face image 

is the surface reflection rate of Pi 
ni indicates the surface vector of the point / 



• is the dot product operation 

x,y,z is the 3-D coordinate of Pj 
[015] It can be seen from the above equation that the feee facial image formation is related to 
the reflection and 3-D shape of the face surface, and the illumination. These are the three 
essential factors in the fee efacial image formation process. The first two terms are related with 
the intrinsic characteristic of the face itself, and also the important information for face 
recognition; the last term, illumination, is the extrinsic factor, and also the primary factor 
which affects face recognition performance. 

[016] Although the light intensity ||.s|| also affects the gray scale of feeefa cial images, this kind 
of influence can be adjusted using a simple linear transform. The top-most factor that affects 
the face recognition performance is the incidence angle of the light relative to the face surface 
vector. Assume that 0 { is the angle between the incident light ray and the face surface vector at 
Pi (0 i g [0,?r]), the light intensity ||s||=l, then Equation (1) maybe expressed as follows: 

li = Pi(x, y) cos 0 t (2 ) 

where , i= 1,2,.,. ,k ; k is the number of pixels of a face image. 

[017] From equation (2), we can see that when 0 t .changes as a result of a change in the 
illumination direction, the feeefac ial image changes accordingly. It can also be illustrated by a 
correlation analysis: Given two fa^facial images lighted from the left side and from the right 
side, respectively, the correlation coefficient of resulting images is generally a negative 
number, this means that the two images are completely different by the pixel values, even 
though of the same person. 

[018] In real applications, the environment lightings generally differ from place to place, and 
a face recognition system has to adapt to different environmental lightings. However, current 
face recognition technology mixes both intrinsic and extrinsic factors in the imaging and hence 
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cannot adapt well to the environment. This is why the best face recognition system can only 
achieve 50% accuracy (see also NIST 2002 Human Face Recognition Vendor Tests Evaluation 
Report (P.J. Phillips, P. Grother, R.J Micheals, D.M. Blackburn, E Tabassi, and J.M. Bone. 
March 2003). 

[019] Although there are many methods for compensation and normalization of illumination 
for face recognition, they are not very effective (see: P. N. Belhumeur, David J. Kriegman, 
"What is the set of Images of an Object Under All possible Lighting Conditions?", JEEE conf. 
On Computer Vision and Pattern Recognition ", 1,996; Athinodoros S. Georghiades and Peter 
N. Belhumeur, "Illumination cone models for recognition under variable lighting: Faces ", 
CVPR, 1,998; Athinodoros S. Georghiades and Peter N. Belhumeur, " From Few to many: 
Illumination cone models for face recognition under variable lighting and pose ", IEEE 
Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, No. 6, P-pp_p_ 643-660, 
2,001; Amnon Shashua, And Tammy Riklin-Raviv, "The quotient image: Class-based re- 
rendering and recognition with varying illuminations ", Transactions on Pattern Analysis and 
Machine Intelligence, Vol. 23, No. 2, Ppl29-139, 2,001; T. Riklin-Raviv and A. Shashua. "The 
Quotient image: Class based recognition and synthesis under varying illumination " m 
Proceedings of the 1,999 Conference on Computer Vision and Pattern Recognition, Pages 566- 
-571, Fort Collins, CO, 1,999; Ravi Ramamoorthi, Pat Hanrahan, "On the relationship between 
radiance and irradiance: Determining the illumination from images of a convex Lambertian 
object ", J. Opt. Soc. Am., Vol. 18, No. 10, 2,001; Ravi Ramamoorthi, "Analytic PCA 
Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian 
Object", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 10, 
2002-10-21; Ravi Ramamoorthi and Pat Hanrahan, "An Efficient Representation for Irradiance 
Environment Maps", SIGGRAPH 01, Pages 497-500, 2,001; Ronen Basri, David Jacobs, 
'Lambertian Reflectance and Linear Subspaces", NEC Research Institute Technical Report 
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2000-172R; Ronen Basri and David Jacobs, Lambertian Reflectance and Linear Subspaces, 
IEEE Transactions on Pattern Analysis and Machine Intelligence, Forthcoming; Terence Sim, 
Takeo Kanade, "Illuminating the Face", CMU-RI-TR-01-31, Sept 28, 2001, etc) Among these 
methods, some requires 3-D modeling of faces, while some assumes known facial shapes. 
These limitations reduce the applicability. Moreover, the computational cost is very high. 
[020] There have been several face recognition patents, most of them using visible lights and 
for applications. One is Chinese patent ZL991 17360.X. There, it is about how to implement the 
face recognition for access control and time attendance, without much attention paid to face 
image acquisition, and influence of skin complexion and light changes. The recognition 
accurate rate of this method under the lighting changes is still low. These limit its applications. 
[021] US Patent (US200 1/003 1072A1) disclosed a device using VISIBL E light sources to 
acti vely ill uminate the face for face reco gnition . The device uses visible lig h t as active light 
sources and hence inherits probl ems existi ng in current vi sible light image based face 
recognition; further, the visible light are intrusive to human eyes especially; this i s e specially 
true when the active lights should be stro ng e nough to override environmental lightings, as is 
the case in US200 1/003 1072A1. That patent did not publicize how to use INVISIBLE infrared 
lights as active light sources to illuminate the face for facial image acquisition and recognition, 
nor is there any information there about how to setup infrared light sources and infrared filters 
for better face image acquisition and recognition. 

[022] There have also been iris recognition techniques for accurate biometric identification, 
such as used in Iridian Corporation's products. Disadvantages of such technology include 
complexity of iris image acquisition apparatess devices. and inconvenience of use. These limit 
the applications. Chinese patent ZL99 110825.6 has also pu blieized diselosed portable iris 
equipment. This equipment is limited by the similar disadvantages. 



SUMMARY OF THE INVENTION 
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* significantly reduce 
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A-faFtheg-obj eot of the invention is to p fevide^-meftred-^^ 



r e c o gn ition, where the face localization and recognition are done in a fast way a c c o r ding to 



a c cu ra te and fa st lo calization of e 



a th e acquired face images; it leads to high recognition 



accu ra c y ■ without th e need fr 



it-B p environmental lights, bein g practic a l an d c 



ap p lioatio 



lighti 

comp act, and hi ghl y aut omatter 

^accomplish- the above objects, t 

meth od, comprisi n g th e follo wmg-atepsf 
s-tartfflg-a-face recognition apparatus ; 



fcat- uses near inirared 

is of tew cost, highly 



s lights to illuminate a target -face when a 



r approaches- s-aid -fac< 



reeogmtten- -apparatus j 

providing an image acquisitio n u nit to capture a plural 
illuminated by-an-aetive-lights-; 



&?ge!r-faee 



sending at least one facial image acquired by said image capturing unit to a data 
processing unit, and det e cting and/or looafei ag-a p osi ti o ns of ey e s and /or said fa o e-by s aid data 
precessing-imitt 

[023] cropping a portion of s a id faoia'Hmag-e-and- The object of the present invention is to 
provide a meth od and . . , i 'us for facial image acquisition and , or . recognition 



th at can o v ere i pi< d i.-. e xisting m the p r i o r a r t, sue , c uracy of face 

recognition is deteriorated due to changes of environmental lightings. The present invention 
al ms to so lve [ i is of pri or ail by using a non-intiUi ,i\>. an user-i ndly mean s, 3 nd to 
adu icn Uj \ n! tac^ i <j u i 

[024] '.ii >i ! ' *' - , -vi*, cntn n h to ; \ u. _ j i i pp. ittu I . 

... : muiij i iti >* '..hctui m ; a> e nu i *.n [« - . u •*■ r . , . Hi* 

t-- hnitn 1 • ,! 1 ' ! " - Fh e me tho d and ap p aratus ca n significantly r e d uc e 

unfavorab le influence caused by variable environmenta l lights. 

[025] -< lurJ ?. rbjev? >l t'u iavvotii-n r lu pi o vile a mdlt. • t .. *. ippr.ratus for lace 

Uvo » , , i - < ' ik !>',[{ „. a! ru. , i .ti'^jj oK>di\e 

NIR ligh t arc • 11 b> 1 .it p uJL • ldijifihl refit el 1 i il luminal 

active lightings. The present method can lead to accurate and fast face recognition. 

[026] The present invention provides a face recognition method, comprisin g the followin g 

steps: 

providing an active infrared light to illuminate a target face when a user approaches an 
image capturing unit, wherein said active infrared light mounted around lens of an image 
ca pturing unit is near infrared (NIR) radiation light sources in invisible light spectrum; 

capturing a plurality of facial images from a target face illuminated by said active NIR 
light sources, and sending a NIR facial image to a data processing uni t: 

localizing said face and / or eyes of said face .and cropping a portion of said facial 
image from said NIR facial image by said data processing unit; 

extracting facial feature from said portion of said facial image-by --said data processin g 

comparing facial feature with that of previously extracted and stored in a faeefacial 
image database; 
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outputting a recognition result obtained from said comparing step. 



activ e light h 



•rfftftafsd-iight-s- 



*^i«M©4ight-s< 



!-flasb4ights r e 



A^xwdbg^e^he-m^^^ 

energy of an active lighting and a environmental lighting on said face area is greater than that 

According -to the ho wAh ,„.e v <> l * . tv&on methed r whefein-a-teta-l 

energy of said active 

Aec o rd i ng to-the inventionr&W 8 : fc provid e d a faoer e oognitio n m et ho d , wh e r e fa-sald 



m e thod far t her m eludes a step o judge w i . i. . face and-eye >• 



ssfol ■! 



v-faee-{mage r i 



, - t ith - ' step < therwis back to m 
proees letecti i fa id- ; or local > < >i 

Accor di ng t o the Inv e ntion, ' ■fee r e-fe'pfevjd e d a fa o^ 'f ewg nitio t i met h od ji' wher e fn said 
method far t he r incl ud es a s tep that it cou ld ohos e to loooliz e th e eye positions by looalizia g-the 
specularity (highlight spot) m each of the eyes. 



Accordi ng to the invention, there is provi d ed a face recogniti on met hod, wherein sai d 



method-fa rther inclu d es a step that said image capturing un it can track said face area 
ilium inated - b y an a ctive lights. 



¥e better accomp lis h t he ab o ve object, the present invention als o p r o v id e a f ac i al I mage 



acquisition metho d, comprising the following st eps-f 

[027] Providing Said face recognition method :s pr»>\ ided. wherein a \'IR tiitcr ts disposed on 

said image capturing unit for cutti ng off visible light radiation while allowing the.NIR light 

radiation to pass rough so as t< impro . ' 1 taec imag e a cqui sition. 



[028] Sai d face recognition methyl is provided, further com prising 0 . oi detecting 

specular highlight reflections in eyes in said NIR face image to localize eye positions and 
the e >y .... ii/'j -a-t 

[029] Said face recognition method is provided, further com p ris i n g the ste ps of: judging 
whether eye- i ^ h loc alized after sending a t k.i t ,• < . < il imag e to a 

data processing unit: if yes., going forward to the next step of cropping a portion of said fa cial 
image, otherwise repeat rag the loeali/.msj step until eyes and or face iv .Mtecessiully localized. 
[030] The present invention further provides. a facial image acquisition method, comprising 

providing a plurality of active lighting infrared lights to illuminate a face area, 

I¥e^ding -«n image -captu rin g m at- for - captarkg a facial- image of a target face, and 
sending wherein said facial- active infrared light mounted around lens of an image capturing unit 
is a near infrared (NIR) light in invisible spectrum; 

providing an image capturing unit for capturing NIR images of said target face, and 
sending / storing said NIR face images t o a data processing unit used for localizing and 
recognizing said target face; 

Wherein a wherein the total energy of said active lighting and MR light plus said 
environmental lighting lightkgs on entire area of said target face area is greater than that of 
environmental lighting! 

Ac co rdin g to t h e kvention, there i s p ro vided a facia l ima ge acquisition m e thod, wher e kt 
on entire area of said total energy of said active lighting and said environmental lighting on 
said target face area-is - no t l o w e t-tfa a n by at least twice that of e nwonment al li tkgtimes 

Aeeo-r dkg - to the kvention, th e r e is provided a f acial-image acquisition method., wherein - 



9< 




there is provid e d a faci al im age acq uisition method. wh< 



4s4M«4igh4- 



Aeeoi4iHg404h€4»v©iite 



position, aft e r a faci al im ag e is captured. 

[031] T o b e tt er accomplish the ab oi^e object, the Said facial image acquisition method is 
provided, wherein a NIR filter is disposed on said image capturing unit for cutting off a visible 
light radiation while allowing a NIR light radiation to pass through, so as to improve NIR 
facial image acquisition. 

[032] The present invention akeiurther provides a facial image acquisition apparatus used for 
realizing a facial image acquisition method, wherein comprising an active NIR light - and an 
image capturing unit, *i p \ ten and *ta pre - unit 
Said aetive lights -u^-~fb^tH«m-u*atirng-a-fe-e<Mrea-; 

Said-powef-switeh use for - oontr effiag- said ac ti ve lights to illum iaa^akl-feee-afeat 



Said data proc e s s ing unit u se d for rec e iv i ng imag es fro m- sai d -image capturing unit, and 
localizing eyes and face in said facial image, cropping a portion of said facial image, and 



said-da ta pew 



ig unit 



-mak 



of the spaoularity fa each of th e eyes to looaliz&Ae-eye 



at least 1 





y extracted and 



stored in a faoial i mag e d ataba; 
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Aeeerd ing to the invent i on, there is p rovid e d a faeM re c ognition a p p a ratu s, wherein a 
Said active NIR light is mounted around lens of said image capturing unit to illuminate a target 
face: 

S<! d Kn p- * j u i " pt '1 * "is i ' -<> 1 * vt ' dlu minated by said 
IV. hi. and sends said NI\ a •« 1 _y 1 .a p» »< mil 
[033] S , .1 xa-/c acquisition sppar.tlu > wherein MR IHtvi dispose 

I it cj.ptuiins unit fo c ting U m hie ku'hM ( i i ' L II ims Ire NIR light 
• u i j Lhrtiu as to tmj > MR (; < . „ i hum 
[034] le. im iv ^qm Jen .*.; u.,iu - s •< kl . n flu s[v vl j - tang,, oj aid 

active NIR light is between 740nm-1700nm; said NIR optical filter is an NIR optical coating or 
an NIR optical glass disposed on the surface or inside of said lens. 

[035] Said facial image acquisition apparatus is provided, wherein said active NIR light 
comprises a plurality of constant NIR lights, or a plurality of flash NIR lights, or the 
combination thereof. 

[036] Said facial image acquisition apparatus is provided, wherein the direction of said active 
NIR li ght is approximately parallel to axis of said lens. 

[037] Said facial image acquisition apparatus is provided, wherein the t otal energy of said 
active lighting andN IR light plus said environmental lightin g lightitigs on entire are a of said 
target face area-is greater than that of environmental lightin gs on entire area of said target face 
by at least twice times . 

According to the invention, there is provided a facial recognition apparatus, wherein a 
position-of said aotive lighting a n d said i mag e capturing unit is relatively fix e d, and a angle 
between a dir e otLon of said active lighting an d a axis o f th e cam e ra lens of said imag e 
apparatus betwe e n 0° to 90°. 
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Aoeeffeg to t he tn v< 
di re ct i o n of active lighting is approx imately parallel to axis of a camera lens. 

Aesofd fit g to the inv e ntio n, there is pro vided a facial re cognition apparatus , wherein said 
a^tiv&4ig}#iag4s-m a de of nea r infrared li ght sou rc es , or visible light-sources . or flash lights.; 
o r a combination of them g— 

According to the invention, there is provided a fecial recognition apparatus, wherein a 
near infrared l igh ts has a wavelength between 740n m-4 000nm, or a plura li ty o f sever a l 



According t o the inventio n, th e r e i s p rovided a facial recogni t ion ap p ar atus, wherein an 
infra red filter is disposed on an infrared camera lens for cutting off visible li gh ts radiation 
- ilk 1 • i i m ... . I u m' la ' . n<n - ^ a ' 

[038] Aeoo fd kg-to tite-Sivention, th e re h provided a facial r e cognition apparatus^ wherein 
tlivi. - t d-p n S»'k1 1- al image icqmstH.., ..pj uat'i - p >\ukd <■ << tern - -I im g. 
capturuig unit includes an NIR optical filter of band-wavelength-pass or long-wavelength-pass 

type, 

[039] The present i n ve ntion fa rther provi de s a facial Im a ge re cognition apparatus used for 
- '*ac racial image rec ration neth k mpnsa n active tnirai li it." > i j 



>.«i- ipt itmg n i in.' o tt ^ucess in i ru 

tcrei - image ipturing tit .ludc lei md --aid t;\e i frared 
comprises a plurali t y of a ctive NIR lights u sed fur illuminating a target face and mounted 
around said lens: 
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said Image capt u ri ng unit is used for ca pt urin g fa cial images and se nding -.: lca« tic 
facial image to said data processing unit; 

said data processing unit comprises a PC or an embed ded processor in wh ich i m age 
processing sohn i t i _i< im u^o* «. n ] > i :ap rii u t and 

)». ,' 'in • ~s irivi 1 l ii I f. 1 i.\ ige> t<ul_ Ii; J i . 

facial area, and comparing the extracted features with that of previously stored in a facial 
image database. 

[040] Said facial image recognition apparatus is provided, wherein the spectrum range of said 
active NIR light is between 740nm-1700nmt said active XIR light comprises a plurality of 
constant NIR lights, or a plurality of flash MR lights, or the combination thereof. 
[041] Said facial image recognition apparatus is provided, wherein the direction of said active 
NIR light is approximately parallel to axis of said lens. 

[042] Said facial image recognition apparatus is provided, wherein said ima ge ca pturing unit 
includes an NIR optical filter of band-wavelength-pass or long-wavelength-pass type, and it is 
used to suppress visible lights while allowing NIR lights to pass through so as to achieve better 
NIR imaging effect. 

[043] Said facial image recognition apparatus is provided, wherein said data processing unit 
includes a means for detecting specular highlight reflection in each eyes in said NIR face 
image, it. is used for localizing said eyes and face through localizing the positions of a highlight 
spots. 

Said facial image recognition apparatus is provided, wherein there is a displaying d evice 
for displaying facial images, used for adjusting the position of a the target face in vertical and 
horizontal directionsr 
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said 4isplaydisplaying device is a mirror or a-an LCD (liquid crystal apparatus (LCD)d isplace).. 
mounted m such a way t h a t i t s surface normal is co-axis to said lens . 

A c c or ding to th e i nvention, t here is provided aSaid facial recognitio n-apparatus . 

-recognition apparatus ^h e r e in 



s ai d d at a process ing unit co mprises a PC / computet 



n embedd ed p r oc e ssor in wh ich ima ge- 



processin g so ftware h in s tal l ed. 



[045] According to th e invention, there ■is provided a facial recognition apparatus, wherein 



id-tie" CrHvltriH-iS f>t< ik.' ) u lAi <. hi i U .p «k . -n't, . . « « * , 

switch, a proximity sensor switch or an RFID controlled switch. 

Aeeofding -te^he-ttw^i^eferAefe-k-^ovided The present invention can effectively 
overcome a facial main problem existing in current visible light image based face r ecognition 
apparatusrvvherein-sa-id-aetiv e lighting is-mounlcd around knsmclhods and systems that their 
accuracy drops because of said image capturing unit 

[046] : Bte"P?e8ent inven tion c an-e-ffeotiveiy^eduee-the unfavorable impact of uncontrolled 
environmental lighting on face f a ci a l images, so-as -to aehieve-high-aocuraey under different 
emTOim^i¥hCT-miise;-A&-fa-oe- and therefore can increase the r ecognition apparatus -uses 
active lighting to ilh aa inatc t he- facc arca ;--wt(it-the-iitfeRgdir-t >f the active lighti ftg-greater-tfaaft 
thato faccuraey under uncontrolled environmental lighting r and with A-e-relative-pos-ttion and 
direction between the active lights and the camera fixed; these give the best possible face 



[047] The above advantages are realized by the invent ed NIR face image acquisition method 
,-r.u ui.m-v v\ - u»\w MR lights., strong enou gh to override en- 1 li ghting, are 



sed U [run mate: die fa i * ma^ ^apfunii >> i 1 < u s irae me vi->ib 1 hh i il 



n on ment are suppressed using an NIR optical filU' ^ i i 

leads to stable imaging properties and hence high recognition accuracy under different lighting 
environments. 

[048] Mo; :, ' .* themvevtedh . "r._ - u, ; 'it 'n i.iihul nd a] j>; • usei-thendh 

because tJ-io actrve NIR ligh ts are m tl i wl >| » i, n and nee to human 

eyes. 

[049] The advantages are further realized by the method and apparatus for the NIR .facial 

image, acquisition and recognition, wherein highlight specularitics in the eyes are located 

quickly and. , ui\ 1 *auj . k.h, . „ e localization 

can re present the face accurately and hence lead to high recognition accuracy. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.l is a schematic diagram of a face recognition process; 

FIG.2 is a schematic flowchart diagram including both face recognition and enrollment 

processes; 

FIG.3 is a schematic illustration of a angle between an active light direction and camera 
lens axis; 

-FIG.4 is a schematic illustration of an exemplar system that embodies a face 
recognition method in the present invention; 

FIG.4a is a procedure for an embodiment of a face recognition method in Fig.4; 

FIG.4b is a diagram of an image acquisition and data processing modules for a system 
in Fig.4; 

FIG. 5 illustrates specular highlight spete reflections in eyes paused by a s reflection of 
active lighting on Uk e\ surface 



FIG.6 is a schematic diagram of a4magmg-eameman image capturing unit with active 

lights; 

FIG.7 is a schematic illustration of an access control system with the present invention 
of face recognition method incorporated; 

FIG.8 is a schematic illustration of an application of the present invention of face 
recognition method in machine readable travel document (MRTD); 

FIG.8a is a schematic diagram of a face image acquisition in the face recognition based 
MRTD system in Fig.8; 

FIG. 8b is a schematic diagram of a face recognition in a face recognition based MRTD 
system in Fig.8. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[050] Detailed embodiments of the present invention are disclosed herein, with an illustrative 
drawings and an exemplar embodiment: 

[051] Fig.4 discloses a preferred embodiment of an imaging system including image 
acquisition apparatus and/or image recognition apparatus according to the present invention., 
comprising active lights (LED) 421, camera 422, mirror (as an aid for face positioning) 423, 
optical filter 424, control switch 426, data processing unit 430, indicator LED, and power 
supply; an active light (LED) are evenly distributed around the camera422, and in the middle 
are the mirror 423, the filter 424 and the camera 422; the mirror 423 is in the middle of the box 
of the imaging system, in the middle of the mirror is the filter 424 and the camera 422; the 
mirror 424 is inside or in frontal of the camera lens. The camera is connected electronically to 
the data processing unit. The control switch 426 is a infrared sensor switch, located in the 
lower part of the imaging box. an indicator illuminator is located above the camera 422. The 
control switch 426 is connected to the active lights 421, the camera 422, illuminator 425, and 
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the power supply, when an infrared sensor fn the switch 426 is triggered on, the switch 426 
turns on the active lights 421 and the camera 422, and the illuminator 425 turns red and 
blinking, meaning active lights and the camera are working; when the switch 426 turns off, the 
active lights 421 and the camera 422 stop, and the illuminator turns green, meaning standby. 
[052] First, the active lights 421illuminate on the face area 410, the camera 422 (which can be 
a web camera, a CCTV camera, or specialized infrared camera) captures an image of the face 
410; the acquired image is transmitted to the data processing unit where face image recognition 
takes place. 

[053] Fig. 4a reveals an embodiment of a face recognition system -apparatus given in the 
present invention, including the following steps: 

Step 100, start a face image acquisition system 420; 

Step 110, when human body approaches the system 420, an infrared sensor is triggered 
on, and the active lights 421 illuminate the face area; 

Step 120, the camera 422 captures images of the face area illuminated by the active 
lights 421; 

Step 130, the camera 422 sends at least one face image to the data processing unit (such 
as a PC or an embedded data proces sing uni processor ) 430; 

Step 140, the data processing unit 430 finds the face from the image and locates the 
positions of the eyes and/or face; 

Step 150, if the eye/face localization is successful , execute step 160; Otherwise, 

execute step 130; 

Step 160, crop the face area from the image; 
Step 170, extract facial feature template; 

Step 180, compare the extracted facial feature template with those stored in the face 
template database; 
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Step 190, output recognition result. 
[054] In the above steps, the total energy of the active lighting 421 and the environmental 
lighting 427 on the face area is greater than twice that of environmental lighting. For example, 
if the strength of the environment lighting is 30 LUX, and that of the active lighting is 
120LUX, then the strength of the active lighting is 4 times that of the environmental lighting. 
[055] In t '. ' kit! Jiv e lights 421 arc MR I • (generally, an aotirv ea ctive NIR 
lights in the present invention can include infrared constat Mi- lights, flash NIR lights, and/or 
visible lights. When-a fl ash light is used, th ecombination of them. The strength of the flash 
t actn e N IR li ghts are much greater than that of environmental lights, hence the influence of 
the latter is much reduced. Similar effect eancoijld be achieved using visible lights. 
[056] hi Fig. 4 and Fig ,4a, the active lights 4 21 can be infra r ed lights. Becau s e human eyes are 
ins ensitive to However, because MR lights are in the mim n - ? spectrum, human eyes 
are insensitive to them, and the active infrared types of ac tive-lights cause*- minimum 
disturbance to the human; meanwhile, an inirarcUMR optimal filter 412 can be added into the 
camera lens o ameras, to cut off visible lights in the environmental lighting, so as to further 
reduce the influence of environmental lighting; therefore, an infrared lighting is NIR lights are 
the most suitable type of active lighting lights . 

[057] In any embodiment of the present invention, whatever type of active lights are used to 
illuminate the face, the relative position between the active lights and the camera should be 
relatively fixed, and the angle between the direction of the active lighting and the axis of the 
camera lens should be in a sharp angle. 

[058] Refer to Fig.4. During the enrollment and recognition processes, the relative position 
between the face 410 and the camera 422 should not be changed, and the face plane and the 
axis of the camera 422 should be perpendicular to each other (i.e. the vector normal to the 
facial plane should be parallel to the axis of the camera); as such, the angle 0 between the 
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normal vector and the camera axis is relatively unchanged, and the resulting image is most 
stable under the active lighting. 

[059] When infrared lighting is used, an infrared optical filter can be mounted on the camera 
lens, so as to cut off the shorter wavelength visible lights, and to further reduce the influence of 
environmental lights. For the present invention, the preferred infrared lights are of near infrared 
in the wavelength range of 740nm-1700nm , or of mid infrared in the w avelength r aage-ef- 
170Qnm-400Qnm. 

[060] When an infrared optical filter is used, the filter can be either band-pass or long-pass 
type. For example, when the infrared lights are 850nm LEDs, a band-pass filter could be 
chosen, such that it has the central wavelength of 850nm to allow infrared ray of around 850nm 
to pass while cutting of ray of wavelengths shorter than 800nm and longer than 900nm; or a 
long-pass filter could be chosen, such that it allows infrared ray of wavelength longer than 
800nm to pass, while cutting off ray of wavelengths shorter than 800nm. 
[061] In Fig.4 and Fig.4b, a data processing umt unit 430 in the present invention can be one 
of PC or an embedded i ma g e data p rocessing uni p rocessor (cf Fig. 4b). 

[062] In Fig.4b, to simplify the apparatus d evice, one could integrate all components into one 
circuit board and install the board in a casing box; the board circuits include the infrared sensor 
switch 426, analog comparator 4223, single-chip microcomputer 4222, camera 422 (eg 
LogiTech Pro4000), control pecker 4221, active lights 421 (near infrared LED array), and 
imbedded i mage data processing unit processor 430 (eg MCS-51 series). 
[063] In Fig.5a and Fig.5b, one could make use of the specular highlights highlight reflections 
in the eyes (Fig.5a) for the eye and face localization, which is an effective and computationally 
efficient means. The active infrared lights cause a specular highlight reflection in an eye, which 
can be seen in the face image. Therefore, one can detect the eyes and the face by detecting the 
highlights in the eyes. After the two highlights in the eyes are detected, one can locate the face 
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area according to the geometric relationship between the two eyes and that between the eyes 
and the face. This enables fast and accurate face localization and much simplifies the face 
detection problem. 

[064] Refer to Fig. 3 again. Let the angle between the active light direction and the camera 
axis be 9, environmental light be Si and active light be S 2 , then the aformentioned equation (1) 
can be written as 

i t = p /(*> y)n t (x> y) T • Ui + s 2 ) ( 3) 

where i=l,2,...,k ; 

If the strength of the active lighting Si is much greater than that of the environmental 
lighting S 2 , \\S 1 I » \\S 2 \\ , then equation (3) can be approximated by: 

where i=l,2,...,k ; 

[065] If in the process of face recognition, a further constraint is imposed, namely, the 
relative position between the face and the camera is un-changed and so is the angle between the 
facial surface normal and active light direction, then according to equation (4), the acquired 
image is determined by the intrinsic properties of the face (ie, facial surface albedo and facial 
surface normal), nearly regardless of environmental lighting. Facial images acquired in such as 
way is most stable and best for face recognition. 

Applications 

[066] Fig.6 and Fig.7 disclose an embodiment of the present invention for face recognition 
based access control. 
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[067] Refer to Fig.7. On a door 400 is an access controller 450. The active light image 
acquisition system 420 transmits the face image to the image-data processing unit 430, the 
pfoses-sdata proce ssin g uni t 430 makes a decision' of acces s permission, and send the decision 
to the controller 450 to grant or deny the access^ 

[068] In Fig.6 and Fig.7, the imaging system 420 includes 8-12 infrared LEDs of wavelength 
850nm. The LEDs are mounted in frontal of the camera, in co-axis to the camera lens (the 
angle is 0 degree when the facial plane is perpendicular to the active light direction). With the 
850nm band-pass infrared filter 423, the ray of 850nm LEDs can pass through the filter, 
whereas ray of other wavelength is cut off. Or a long-pass filter may be used to allow ray of 
wavelength above 800nm to pass while cutting off ray below 800nm. The camera captures 
images of the face 410, and sends them to the image data processing unit 430.- Making use >■-&£ 
the ■ specul ar h i gh ligh ts , t he processor-detects the positions of the eyes and hence that of the 
face; the pose of the face is then corrected, and facial feature template extracted and compared; 
a recognition decision is made. The data processing unit then sends a signal to the controller 
according to the decision result, to control the access of the door. In this embodiment, the 
image-data processing unit is a desktop PC. 

[069] Figs.8, 8a and 8b disclose another embodiment of the present invention for face 
biometric based machine readable travel document (MRTD) . The first phase is face image 
enrollment, shown in Fig.8a, including the following major steps: 
Step 300, start an image enrollment system; 

Step 310, the passenger hands in the travel document 502 when the body approaches to 
within about 50cm from the counter 500. The infrared sensor switch turns on the active lights 
(near infrared LEDs) to illuminate the face area; 

Step 320, the passenger moves his head so that he can see his face in the middle of the 
mirror, so that the active light camera with an optical filter can take pictures of the face; 
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Step 330, the camera captures at least one image and send it to the image-data 
processing unit (or a PC); 

Step 340, the data processing unit locates the two highlight spots from the image; 

Step 350, if two highlights are detected, execute S360, otherwise, execute S330; 

Step 360, crop the face area from the image, based on the two detected highlight spots; 

Step 370, extract facial feature templates); 

Step 380, store the extracted facial template(s). 
[0701 Fig. 8b discloses further details of face image acquisition and processing, including the 
following steps: 

Step 200, start a face recognition system -apparatus ; 

Step S210, the passenger hands in the travel document 502 when the body approaches 
to within about 50cm from the counter 500. The infrared sensor switch turns on the active 
lights (near infrared LEDs) to illuminate the face area; 

Step 220, the passenger moves his head so that he can see his face in the middle of the 
mirror, so that the active light camera with an optical filter can take pictures of the face; 

Step 230, the camera captures at least one image and send it to the image- data 
processing unit (or a PC); 

Step 240, the data processing unit locates the two highlight spots from the image; 

Step 250, if two highlights are detected, execute S360, otherwise, execute S230; 

Step 260, crop the face area from the image, based on the two detected highlight spots; 

Step 270, extract facial feature template; 
Step S280, compare the extracted facial template with those stored in the database; 

Step 290, output recognition result. 
[071] In real applications, the face enrollment system and the face recognition system can be 
built into one combined system. The difference is that the latter does not include the enrollment 

25 



phase. The custom inspector checks the documents against the enrolled passenger, associate the 
personal information with the enrolled facial image, and test whether the person can be verified 
his identity successfully by the system. 

[072] In the embodiment shown in Fig.8, the mirror can be replaced by an LCD display, so 
that the user can adjust the head position according to the feedback image shown on LCD. One 
may use a digital camera type apparatu s d evice as a-an image capturing unit and also use it as 
the display. 

[073] Further, the imaging system of the present invention can be on a motion platform, to be 
an elevator-pan-tilt-zoom camera unit. Such a apparatus device can track the people, control the 
active lights, and capture face images. It also caters for people of different heights. 
[074] The present invention can enable face recognition in the complete darkness without 
environmental lighting. 

[075] The present has further advantages such as being highly accurate and stable, compact, 
low in cost, autonomous, convenient to use in various applications and for installation and 
maintenance. 

[076] New characteristics and advantages of the invention covered by this document have 
been set forth in the foregoing description. It will be understood, however, that this disclosure 
is, in many respects, only illustrative. Changes may be made in details, particularly in matters 
of shape, size, and arrangement of parts, without exceeding the scope of the invention. The 
scope of the invention is, of course, defined in the language in which the appended claims are 
expressed. 



Claims 



What is claimed is: 

1. A method for person identification by biometric analysis of facial 
the steps of: 

starting a face recognition apparatus ; 

providing an active lights to illuminate a targ et fac e when an user approaches said face 

providing an image acquisition unit to capture a plurality of images from a target face 
illuminated by an active lights; 

sending at least one facial image acquired by said image capturing unit to a data 
processing unit, and detecting and/or localizing a positions of eyes and/or said face by said data 

cropping a portion of said facial image and extracting facial feature from said portion of 
said facial image by said data processing unit; 

g facial feature with that of previously extracted and stored in a face databas e ; 



2. The method of olaim 1, wherein said active lights are n e ar infrared lighting sources, or 
visibl e light souro e s, or flash lights, or any combination of th e m. 

3. The method of claim 1 or 2, wherein a total energy of an active lighting and 
environmental lighting on said face area is greater than that of environmental lighting. 

4 . The method of olaim 3 , wher ei n a total energy of active lights and environmental 
lightings on said faoial area is greater or equal to twice an energy of said e nvironmental 
lightings. 

5. The method of olaim 2, wherein, after sending at least one faoial image to a data 
processing unit, said method further includes a step of judging whether localizing eyes and/or 
face is suooessful; if yes, execute next s tep, otherwise do localizing step again; 

6. The method of olaim 1, 2, 4 or 5, wherein a step of sending at least one face image, 
there inoludes a step of detecting specular highlights in the eyes in said face image and thereby 
detecting eye positions. 

7. The m e thod of claim 6, wh e r e in said method furth e r includes a step that 3aid imag e 
capturing unit can track said face area illuminat e d by an activ e lights. 

8. A method for facial image acquisition, comprising the steps of : 
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Providing a plurality of active lighting to illuminate a faoe area, 
Providing an image capturing unit for capturing a facial image of a target face, and 
sending said facial image to a data processing unit used for localizing and recogn izin g sai d 

Wherein a total energy of said active lighting and s aid environmental lighting on said faoe 
area is greater than that of environmental lighting. 

9. The method of claim 8, wherein a total energy of said active lighting and said 
environmental lighting on said face area is great e r or equal to twice an en e rgy of said 
environmental lighting. 

10. The method of claim 8 or 9, wherein a relative position between said active lighting 
and said image apparatus is relatively fixed, and a direction of said active lights and an axi s of 
a camera lens of said image apparatus are in a sharp angle. 

1 1. A method according to in claim 8, wherein said activ e lighting are n e ar infrared light 
sourc e s, or visibl e light sources, or flash lights, or any combination of them. 

12. The method of claim 1 1, wherein said data processing unit can make use of the 
specularity in each of the eyes to localize the eye position, after a facial image is captured. 

13. A facial image acquisition apparatus used for realizing the method of claim 1, 
comprising an active light, an image capturing unit, a power switch and a da t a proc essings 

Said activ e lights used for illuminating a fao e area; 

Said power switch use for controlling said active lights to illui 

Said image capturing unit used for capturing facial images of said fao e area, and sending 
at least one facial image to said data proc e ssing unit; 

Said data processing unit used for receiving images from 3aid image capturing unit, and 
localizing eyes and face in said facial image, cropping a portion of said facial image, and 
extracting facial features, and comparing facial features with that of previously extracted and 
stored in a facial image database. 

1 4 . The apparatus of claim 13, wherein a total energy of said active lights and said 
environmental lighting on said face area is greater than an energy of sai d environmental 



15. The apparatus of claim 14, wherein a position of said active lighting and said image 
capturing unit is relatively fixed, and a angle between a direction of said active lighting and a 
axis of the camera lens of said image apparatus between 0° to 90°. 

16. The apparatus of claim 15, wherein the direction of said active lights is 
;ly parallel to an axis of a camera lens. 



17. Th e apparatus of claim 15 or 16, wher e in said activ e lights are n e ar infrared light 
sourc e s, or visibl e light sources, or flash lights, or any combination of them. 

18. The apparatus of claim 17, wherein wav e l e ngth of said active lights are in a range of 
7 4 0nm 4 000nm, or a plurality of several wavelengths in said rang e . 

19. Th e apparatus of claim 11, 15, 16or 18, wher e in an infrared filter is disposed on an 
infrar e d cam e ra len s for cutting off visibl e lights radiation whil e allowing near infrared light 
radiation to pass through. 

20. The apparatus of claim 19, wherein said infrared optical filter is of ban - pass or long - 
pass typo, to suppr e ss active lights while allowing infrared active lights to pass. 

21. The apparatus of claim 11, 15, 16, 18 or 20, wherein there is a display device for 
displaying facial imag e , used for adjusting the po s ition of a targ e t face in vertical and 

22. The apparatus of claim 21, wherein said displaying device is a mirror or an LCD 
(liquid crystal displace). 

23. The apparatus of claim 13 or 22, wh e r e in said image capturing unit i s a vid e o earn e r; 
or a digital camera. 

2 4 . The apparatus of claim 13, wherein said data processing unit comprises a PC / 
computer or an embedded processor in which imago processing software is installed. 

25. The apparatus of claim 13, wherein said power 3witch is a proximity sensor switch o 

woio a§/8jr^ ontrollcdswitch - 

i 26. The apparatus of claim 13, 1 4 , 16, 17, 18, 19, 20, 22, 24 or 25, wherein said activ 

lights are mounted around a lens of said image capturing unit. 

What is claimed isf 
| 1. A method of face recognition . comprising the steps of: 

providing an active infrared light to illuminate a target face when a user approaches an 
image capturing unit, wherein an active infrared light mounted around lens of said image 
capturing unit is a near infrared (NTR) light in invisible light spectrum: 

capturing a plurality of facial images from a target face illuminated by said active NIR 
light, and sending aNIR facial image to a data processing unit: 

localizing said face and / or eves of said face, and cropping a portion of said facial image 
from said NIR facial image bv said data processing unit: 
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extracting facial feature from said portion of said facial image; 

comparing facial feature with that of previously extracted and stored in a facial image 
database; 

outputting a recognition result obtained from said comparing step. 

2. The method of claim 1, wherein a NIR filter is disposed on said image capturing unit 
for cutting off visible light radiation while allowing the NIR light radiation to pass through, so 
as to improve NIR face image acquisition. 

3. The method of claim 1, further comprising the steps of: 

detecting specular highlight reflections in eyes in said NIR face image to localize eye 
positions and thereby localize said face. 

4. The method of claim 1. further comprising the steps of : 

judging whether eyes and/ or face is successfully localized after sending at least one facial 
image to a data processing unit; if yes, going forward to the next step of cropping a portion of 
said facial image, otherwise repeating the localizing step until eyes and/or face is successfully 
localized. 

5. The method of claim 1, wherein said image capturing unit can track the movement of 
target face illuminated by said active NIR light 

6. A method for facial image acquisition, comprising the steps of: 

providing a plurality of active infrared lights to illuminating a target face, wherein said 
active infrared light mounted around lens of an image capturing unit is a near infrared (NIR) 
light in invisible spectrum; 

providing an image capturing unit for capturing NIR images of said target face, and 
sending /' storing said NIR face images to a data processing unit used for localizing and 
recognizing said target face. 

7. The method of claim 6, wherein a NIR filter is disposed on said image capturing unit 
for cutting off visible light radiation while allowing the NIR light radiation to pass through, so 
as to improve NIR face image acquisition. 

8. An facial image acquisition apparatus used for realizing the method of claim 6, 
comprising an active infrared light and an image capturing unit, 
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Wherein said image capturing unit includes a lens; and said active infrared light used for 
illuminating a target face comprises a plurality of active NIR lights mounted around said lens; 
and said image capturing unit sends at least one facial image to a data processing unit 

9. The apparatus of claim 8, wherein said active NIR lights comprises a plurality of 
constant NIR light sources, or a plurality of flash NIR light sources, or the combination thereof. 

10. The apparatus of claim 8. wherein the direction of said active NIR lights is 
a pproximately parallel to an axis of said lens. 

1 1. The apparatus of claim 8. wherein said image capturing unit includes an NIR optical 
filter of band-wavelength-pass or long-wavelength-pass type, and it is used to suppress visible 
lights while allowing NIR lights to pass through so as to achieve better NIR imaging effect. 

12. The apparatus of claim 1 1. wherein said NIR optical filter is an NIR optical coating 
or an NIR optical glass disposed on the surface or inside of said lens. 

13. An facial image recognition apparatus used for realizing the method of claim 1, 
comprising an active infrared light and an image capturing unit, and a data processing unit; 

wherein said image capturing unit includes a lens; and said active infrared light compris es 
a plurality of active NIR lights used for illuminating a target face and mounted around said 
lens; 

said image capturing unit is used for capturing facial images and sending at least one 
facial image to said data processing unit; 

said data processing unit comprises a PC or an embedded processor in which image 
processing software is installed, used for receiving images from said image capturing unit and 
localizing eyes and face in said facial images, and extracting facial features in said localized 
facial area, and comparing the extracted features with that of previously stored in a facial 
image database. 

14. The apparatus of claim 13, wherein said active NIR light comprises a plurality of 
constant NIR lights, or a plurality of flash NIR lights, or the combination thereof. 

15. The apparatus of claim 13, wherein the direction of said active NIR light is 
a pproximately parallel to axis of said lens. 
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16. The apparatus of claim 13, wherein said image capturing unit includes an NIR optical 
filter of band-wavelength-pass or long-wavelength-pass type, and it is used to suppress visible 
lights while allowing NIR lights to pass through so as to achieve better NIR imaging effect. 

17. The apparatus of claim 13, wherein said data processing unit includes a means for 
detecting specular highlight reflection in each eyes in said NIR face image, it is used for 
localizing said eyes and face through localizing the positions of a highlight spots. 

18. The apparatus of claim 13, wherein there is a displaying device for displaying facial 
images, used for adjusting the position of the target face in vertical and horizontal directions; 
said displaying device is a minor or an LCD (liquid crystal displace), mounted in such a way 
that its surface normal is co-axis to said lens. 

19. The apparatus of claim 13, wherein said active NIR light can be controlled by a 
power switch, a proximity sensor switch or an RFID controlled switch. 
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